Original Paper
Abstract
Background: The COVID-19 pandemic has triggered major global challenges, highlighting the need for timely surveillance and accurate forecasting to curb disease transmission and reduce the health burden. Traditional modeling approaches usually rely on aggregated data on confirmed cases. However, testing data can be unreliable due to low availability and uptake, as well as registration delays. In Sweden, the 1177 health care helpline provides valuable syndromic surveillance data that can capture early signals of infection prior to confirmation through testing.
Objective: This study aims to evaluate the effect of integrating syndromic surveillance data on short-term COVID-19 forecast accuracy.
Methods: We developed a novel epidemiological model named SIsIcHRD (susceptible-infectedsuspected-infectedconfirmed -hospitalized-recovered-deceased), incorporating data from the 1177 health care helpline cross-linked with national registers on COVID-19 testing, hospitalizations, and deaths. In the novel model, the population with infection is divided into suspected infections (Is; those reporting symptoms to 1177) and confirmed infections (Ic; those who tested positive). Accuracy metrics of this model are compared to a model without data from the 1177 health care helpline. To evaluate model performance across different pandemic phases between March 2 and December 31, 2020, we used a daily rolling-window approach with a 60-day fitting period to predict confirmed infections, hospitalizations, and deaths over the subsequent 30 days. Prediction performance was evaluated using mean absolute error and mean absolute percentage error (MAPE).
Results: The proposed SIsIcHRD model successfully captured the temporal dynamics of confirmed, hospitalized, and death cases. The model achieved a median mean MAPE of 61.6% (IQR 37.6%-79.6%) for confirmed cases, 37.5% (IQR 18.9%-57.5%) for hospitalizations and for deaths, the model achieved a median MAPE of 0.65% (IQR 0.3%-1.9%), indicating substantially higher predictive accuracy for severe outcomes compared to confirmed infections and hospital admissions. Compared to the model without syndromic surveillance data, short-term forecasting performance of the SIsIcHRD model reduced MAPE by an average of 15.7 percentage points for confirmed cases, 8.17 percentage points for hospitalizations, and 1.99 percentage points for deaths. Overall, the results demonstrate predictive stability for severe outcomes during the early phase of the pandemic.
Conclusions: The proposed model demonstrated predictive performance by integrating individual-level data with health care helpline syndromic data on testing and severe disease outcomes, capturing early signals from symptomatic individuals and distinguishing suspected cases from subsequently confirmed infections, leading to better forecasts of severe outcomes such as hospitalizations and deaths. This framework can support public health decision-making in future outbreaks.
doi:10.2196/104804
Keywords
Introduction
Pandemics have repeatedly caused significant loss of life and triggered severe economic crises worldwide []. In 2019, the world encountered one of the deadliest pandemics in modern history, the SARS-CoV-2, also known as COVID-19, which resulted in approximately 18.2 million deaths worldwide from January 1, 2020, to December 31, 2021 []. SARS-CoV-2 belongs to the coronavirus family and is primarily transmitted from human to human. Among coronaviruses, it is considered the most contagious []. Due to its rapid global spread, the World Health Organization officially declared it a global pandemic on March 11, 2020 []. In Sweden, the first COVID-19 case was reported on January 31, 2020, involving a traveler who had arrived from Wuhan, China []. By mid-March 2020, the virus had spread across all regions of Sweden, posing significant challenges for public health surveillance and health care systems [,]
Effective monitoring of community-level disease transmission is crucial for public health and health care systems []. To predict and monitor disease transmission, evaluate the course of the pandemic, and assess the impact of public health intervention policies, epidemiological mathematical models are often used []. Such models have proven to be valuable tools for policymakers, enabling data-driven decision-making by exploring different scenarios and their potential outcomes in a controlled manner [,]. Among these, the susceptible-infected-recovered (SIR) model is widely regarded as one of the most fundamental and influential frameworks for describing the transmission dynamics of infectious diseases []. Over time, several extensions of the SIR model, including susceptible-infected-recovered-susceptible, susceptible-exposed -infected-recovered, and susceptible-infected-susceptible, have been developed to improve short-term infection forecasting [-].
While various approaches exist, much of the focus has traditionally been on confirmed cases identified through widespread testing programs. However, traditional case counts are often insufficient for early detection of novel infectious diseases due to limitations in testing capacity and laboratory resources []. Syndromic surveillance offers an effective alternative, providing a more comprehensive view of disease dynamics [-]. For instance, in the United States, researchers developed a smartphone-based syndromic surveillance system and identified loss of taste and smell as strong predictors of COVID-19 infection []. Similarly, app-based self-reported symptoms data have been used to predict COVID-19 cases in Sweden, England, and the United Kingdom [-]. Recent studies have indicated that integrating data-driven and epidemiological models, when combined with syndromic and digital data sources, can improve the rapid detection and prediction of infectious diseases. Mathematical and computational models have not only guided immediate responses but also informed medium- and long-term strategies, playing a crucial role in policy planning, public health interventions, and global coordination during the pandemic []. Similarly, in a study conducted in 2021, the authors used time series of online search query frequencies to gain insights into COVID-19 prevalence across multiple countries []. In these studies [,], the authors extended classical compartmental models by incorporating media coverage as a behavioral and informational factor influencing disease transmission dynamics. Drew et al [] introduced a COVID-19 Symptom Study app in 2020 to collect large-scale, real-time data on symptoms, risk factors, and outcomes, which was subsequently used for scalable epidemiological analysis and modeling to inform public health response.
To respond effectively to outbreak events, policymakers must be well-prepared, relying on real-time and historical data collected from epidemiological, health care, and social processes [-]. In Sweden, syndromic surveillance has become a valuable complement to traditional public health monitoring, offering real-time insights into the spread of COVID-19 and other infectious diseases []. One important source of syndromic data is Sweden’s National Telehealth Service, the 1177 health care helpline, which often serves as a first point of contact with the health care system for patients. While data are captured for administrative purposes, they have been used in several epidemiological studies for early detection of water-borne disease outbreaks and during the COVID-19 pandemic [-]. For example, Spreco et al [] used aggregated 1177 data as an early signal to estimate potential health care demands in the upcoming weeks. Moreover, a study conducted in 2024 found that calls to Sweden’s 1177 health care helpline reporting COVID-19–related symptoms were important predictors of hospitalizations during the early phase of the pandemic [].
While previous studies highlight the potential of syndromic surveillance data for disease monitoring, their added value when linked to comprehensive individual-level health register information for improving model accuracy remains poorly understood. In contrast to previous approaches based primarily on aggregated syndromic surveillance data, our study integrates individual-level 1177 symptom data with linked health register information within a compartmental transmission model, allowing individuals to be followed from symptom reporting through subsequent testing and severe disease outcomes. Therefore, in this paper, we extend traditional mathematical models to incorporate a compartment for suspected infection based on individual-level syndromic surveillance data linked with health register data. This approach enables the model to capture early symptomatic signals at the individual level and connect them with subsequent testing outcomes and severe disease progression. The aim of this study is to assess the effect of this integration on the accuracy of short-term infectious disease predictions using a model without syndromic surveillance data as a benchmark.
Methods
Overview
The study population consists of all individuals registered in Sweden on December 31, 2019. The first year of the COVID-19 pandemic was analyzed, covering the period from March 2 to December 31, 2020. Daily confirmed infections, hospitalizations, and deaths were incorporated to capture the temporal dynamics of the disease. This section outlines the data sources, model formulation, and discusses the process for tracing the flow of individuals through the different model compartments using individual-level data.
Data Sources
Information on key symptoms, including fever, cough, and shortness of breath, was extracted from 1177 records and used as the basis for defining suspected infections in the modeling framework. Telehealth call data were obtained from the Swedish 1177 health care advice helpline. During the COVID-19 outbreak in 2020, the number of people calling the helpline for advice on COVID-19–related symptoms spiked, providing valuable syndromic surveillance information []. Individual-level demographic data were retrieved from the Swedish Total Population Register. Information on laboratory-confirmed cases was obtained from the national register on notifiable diseases, SMINet, maintained by the Public Health Agency of Sweden. Data on hospital admissions for COVID-19 were extracted from the National Patient Register, while dates of death were obtained from the Swedish Tax Authority. Individual-level data from the 1177 health care helpline were linked with multiple national register-based data sources using the personal identification number assigned to all Swedish residents at birth or immigration. This linkage enables tracking of individuals from symptom reporting to testing outcomes, hospitalization, death, or recovery.
Epidemiological Model
In this study, we developed 2 epidemiological models. The first is a baseline model, referred to as the SIcHRD (susceptible-infectedconfirmed-hospitalized-recovered-deceased) model. The second is an extended version of this framework that integrates data from the 1177 health care helpline, termed the SIsIcHRD (susceptible-infectedsuspected-infectedconfirmed -hospitalized-recovered-deceased) model. The only difference between the models is the addition of the Is compartment that integrates the 1177 symptom data, while all other compartments and transitions remain unchanged in . No births or natural deaths were included in the model due to the relatively short study period.

SIcHRD Model
This baseline model divides the population into 5 compartments: susceptible (S), infectedconfirmed (Ic), hospitalized (H), recovered (R), and deceased (D). The corresponding system of differential equations governing the dynamics of each compartment is given below. The model parameters along with their descriptions are summarized in .
Here, β denotes the transmission rate, p2 represents the probability of an individual becoming infected, and εc corresponds to the proportion of individuals who develop severe symptoms requiring hospitalization. γ is the recovery rate for individuals with infection, while μ denotes the rate of death among nonhospitalized cases. p3 represents the probability that an individual is directly admitted to the hospital without prior testing, α is the recovery rate for hospitalized patients, and η indicates the rate of death within the hospital.
| Symbols | Description |
| βs & βc | Transmission rate of Is & Ic compartments |
| p1 | Probability that a susceptible individual calls and reports COVID-19–related symptoms to the 1177 health care helpline. |
| p2 | Probability that an individual with infection tested positive without calling 1177 |
| p3 | Probability that an individual with infection is directly hospitalized |
| ψ | Individuals who report COVID-19–like symptoms to the 1177 health care helpline but are subsequently tested negative for COVID-19. |
| π | Return to S (if not in Ic or H within 14 days) |
| ϕ | Transition of individuals who reported symptoms and tested positive |
| εs | Rate of severe progression from Is to H compartment |
| εc | Rate of severe progression from Ic to H compartment |
| γ, α | Recovery rates from Ic & H compartments |
| μ, η | COVID-19–related death rates in Ic & H compartments |
SIsIcHRD Model
To incorporate early symptom reporting and detect untested cases, the SIcHRD model extends by including individual-level 1177 health care helpline data. In the proposed model, the infected compartment is divided into 2 subgroups, Is and Ic, resulting in the SIsIcHRD model.
Individuals in the susceptible compartment may become infected upon contact with infectious individuals, who can be either Ic or Is. The transmission rates differ for these 2 categories, as some suspected cases may not be infected. βc denotes the transmission rate from confirmed individuals, while βs represents the transmission rate from suspected individuals. The rate of change of the susceptible compartment over time is given by:
The Is compartment represents individuals who reported their symptoms to the 1177 health care helpline. The probability p1 represents the fraction of individuals with infection who call and report COVID-19 symptoms before any positive test or hospital admission enters the Is compartment. Individuals remain in this compartment for 14 days and return to S at a rate π unless they are tested positive (transition to Ic at a rate ϕ), are hospitalized (transition to H at a rate εs), or are tested negative (return to S at a rate ψ). The rate of change of the Is compartment over time is given by:
The dynamics of the Ic individuals change over time as some newly people with infection test positive for COVID-19. This includes 2 groups: individuals who tested positive without contacting the 1177 health care helpline (at a rate of p2), and those who reported their symptoms to the 1177 health care helpline and subsequently tested positive within 14 days (at a rate of ϕ). Individuals leave compartment Ic at the same rates as in the SIcHRD model. The rate of change of the Ic compartment over time can be expressed as follows:
The number of hospitalized individuals increases as severe cases arise from the Is and Ic compartments at rates εs and εc, respectively. Additionally, p3 represents the probability that the fraction of individuals with infection neither called the 1177 health care helpline nor tested positive and directly required hospitalization. Hospitalized patients leave this compartment either by recovering at a rate α or by dying due to COVID-19 at a rate η, consistent with the SIcHRD model assumptions. The rate of change of the hospitalized compartment over time can be expressed as follows:
The number of recovered individuals increases at the same rate as in the SIcHRD model. The rate at which the recovered compartment changes over time can be expressed as follows:
The number of deceased individuals increases as people die due to COVID-19 from the Ic compartment at rates μ, as well as from the hospitalized compartment at rate η. The rate of change of the deceased compartment can be expressed as follows:
Parameters Estimation and Model Calibration
To evaluate model performance, the first step involves optimizing model parameters. A total of 14 unknown parameters were estimated using individual-level data, that is,
. The study population could be directly assigned to their respective compartment at any given time point. Hence, the initial conditions of all compartments were directly extracted from the individual-level data. The stepwise fitting and prediction procedure is described as follows:
A short-term fitting and rolling calibration framework was applied in this study, consistent with the use of moving or sliding-window approaches in previous short-term forecasting studies [,]. These studies have used different fitting, evaluation, and prediction periods and step sizes. In this study, a 60-day moving fitting window with a 1-day step size was used. At each prediction date, the model parameters were estimated using the preceding 60 days of observations and subsequently used to generate predictions for the following 30 days. The 60-day fitting window was selected to provide sufficient observations for reliable parameter estimation while maintaining the ability to capture temporal variations in transmission patterns. Random values between 0 and 1 were used as initial parameter values. The parameters were then optimized by solving the system of model equations numerically using MATLAB’s ode15s solver, suitable for stiff equations, while minimizing the objective function that quantifies the discrepancy between observed (actual) yiobs and model predicted values yipred at each time point i, where n denotes the total number of days:
Model Prediction and Evaluation
The fitted parameters were subsequently used to generate model predictions. After parameter estimation, the model was simulated for the following 30 days, and the predicted values were compared with the observed data for validation. Model performance was assessed using the error metrics mean absolute error (MAE) and mean absolute percentage error (MAPE).
Here, yiobs denotes the observed (actual) number of cases (eg, confirmed infected, hospitalized, and number of deaths actual cases) at time point i, and yipred represents the corresponding model-predicted value. The index i = 1,2,...,n refers to the total number of observed time points (days). To further evaluate predictive performance, both the baseline model and the extended model incorporating 1177 syndromic surveillance data were fitted using a 60-day rolling window. These fitted models were then used to generate 30-day-ahead predictions for confirmed cases, hospitalizations, and deaths. The study period spans from March 2, 2020, to December 1, 2020. Model calibration and forecasting were performed using a rolling-window approach, with a 60-day fitting window followed by a 30-day prediction window. The fitting window was shifted forward by 1 day for each subsequent calibration. A total of 216 daily error values were analyzed for each compartment over the evaluation period (May 1, 2020, to December 1, 2020). For further analysis, the evaluation period was divided into 3 distinct periods. Period 1 covers (May 1, 2020, to June 10, 2020), period 2 spans (June 11, 2020, to August 31, 2020), and period 3 includes (September 1, 2020, to December 1, 2020).
Ethical Considerations
This study was reviewed and approved by the Swedish Ethical Review Authority, with original permit number 2020-06492 and subsequent amendments 2021-01115, 2022-01355-02, 2022-06118-02, and 2024-02342-02.
Results
The number of callers reporting each symptom, together with the corresponding counts of confirmed infections (Ic), hospitalized, and no confirmed infection, was summarized in . A substantial number of individuals reporting symptoms were later classified as having no confirmed infection (unconfirmed symptomatic callers with respect to COVID-19). In particular, 312,784 (94.78%) individuals reported breathing difficulties, 468,379 (94.41%) reporting fever, and 326,623 (95.43%) reporting cough were identified as having no confirmed infection. This group includes individuals who tested negative as well as those who were not tested and were not subsequently observed in any other compartment within a 14-day follow-up period. This high number of unconfirmed symptomatic callers may reflect heightened public concern, stress, and anxiety during the pandemic, particularly during the initial phase in March-April 2020 when 1177 call volumes increased sharply. In addition, the limited availability of COVID-19 testing during this early phase may have resulted in symptomatic individuals remaining unconfirmed despite potentially having an infection.
| Symptoms | Suspected infections (Is) | Confirmed infections (Ic), n (%) | Hospitalized (H), n (%) | No confirmed infection, n (%) |
| Breathing difficulties | 330,066 | 13,407 (4.06) | 3875 (1.17) | 312,784 (94.78) |
| Fever | 496,087 | 23,497 (4.74) | 4211 (0.85) | 468,379 (94.41) |
| Cough | 342,248 | 13,749 (4.01) | 1876 (0.55) | 326,623 (95.43) |
The MAE and MAPE of infected confirmed cases (Ic) for the models with and without 1177 data, along with their difference over time, are presented in (panels A and B). The time series analysis shows clear temporal variation in model performance. Early in period 1, the model incorporating 1177 data generally exhibits lower prediction errors compared to the model without 1177. However, during the summer starting period (period 2), both models show increased error, with relatively higher variability in the model with 1177. Late in period 3 (November-December), the model with 1177 again demonstrates improved performance, with lower error compared to the model without 1177. Specifically, the median MAPE difference was 5.26% (IQR –4.80% to 25.25%) in period 1, –0.07% (IQR –22.96% to 46.22%) in period 2, and 0.0008% (IQR –1.75% to 0.07%) in period 3.
Furthermore, box plot analysis (, panels C and D) compares the distribution of MAE and MAPE for both models across the 3 periods. In period 1, the model incorporating 1177 shows a median MAPE of 31.37% (IQR 20.03%-39.96%), compared to 33.33% (IQR 25.73%-58.86%) for the model without 1177. In period 2, the model with 1177 yields a median MAPE of 82.90% (IQR 74.51%-160.5%), compared to 98.13% (IQR 63.82%-168.5%) without 1177. In period 3, the model with 1177 reports a median MAPE of 59.35% (IQR 35.72%-64.11%), whereas the model without 1177 shows a median MAPE of 56.94% (IQR 49.35%-64.12%).
Finally, (panel E) illustrates the fitting and prediction performance of both models. The model incorporating 1177 data achieves a MAE of 488.58, whereas the model without 1177 data shows a substantially higher MAE of 16901.38, indicating poor predictive performance in the absence of helpline data.

(panels A and B) presents the MAE and MAPE of hospitalized cases (H) for the models with and without 1177 data, along with their temporal difference. The time-series analysis reveals clear variations in model performance across different epidemic periods. Early in period 1, the model incorporating 1177 data generally performs better. However, during the summer period (period 2), both models exhibit poorer performance, with slightly higher errors observed in the model with 1177. In the subsequent period 3, the relative performance alternates, with the model with 1177 showing improved accuracy at certain time points, while the model without 1177 performs better at others. Specifically, the median MAPE difference was 0.0097% (IQR –2.69% to 8.57%) in period 1, 0.42% (IQR –9.38% to 42.24%) in period 2, and –1.27% (IQR –9.08% to 1.19%) in period 3.
Panels C and D in present box plots of MAE and MAPE for both models, enabling a period -wise comparison. In period 1, the model incorporating 1177 achieves a median MAPE of 11.72% (IQR 9.17%-16.05%), compared to 15.73% (IQR 9.06%-35.95%) for the model without 1177. In period 2, the model with 1177 yields a median MAPE of 57.33% (IQR 35.47%-70.77%), which is lower than the 70.73% (IQR 41.68%-98.95%) observed for the model without 1177. In period 3, the model with 1177 reports a median MAPE of 39.44% (IQR 23.60%-53.76%), whereas the model without 1177 shows a slightly lower median MAPE of 33.80% (IQR 17.69%-48.70%).
Finally, panel E in illustrates the fitting and prediction performance for hospitalized cases. The model incorporating 1177 data achieves a MAE of 63.86, compared to 2128.59 for the model without 1177 data, demonstrating that inclusion of 1177 data substantially improves the model’s ability to capture hospital burden, particularly during the early stages of the pandemic.
(panels A and B) presents the MAE and MAPE of deaths (D) for the models with and without 1177 data, along with their temporal differences. The time-series analysis indicates that both models perform well throughout the evaluation period, with the model incorporating 1177 data showing improved performance during period 1. Overall, the difference in MAPE between the 2 models remained small, with the median MAPE difference remaining below 1.20% across the entire evaluation period, suggesting comparable predictive performance for mortality estimation.
Panels C and D in present box plots of MAE and MAPE distributions across the 3 evaluation periods. In period 1, the model incorporating 1177 data achieves a median MAPE of 1.71% (IQR 1.01%-3.93%), compared to 2.93% (IQR 1.48%-22.50%) for the model without 1177 data, indicating improved accuracy when incorporating symptom-reporting information. In period 2, both models demonstrate similar performance, with the model including 1177 data yielding a slightly lower median MAPE of 0.36% (IQR 0.17%-0.69%) compared with 0.38% (IQR 0.07%-0.74%) for the model without 1177 data. In period 3, the model without 1177 data performs marginally better, with a median MAPE of 0.94% (IQR 0.04%-3.07%) compared with 1.06% (IQR 0.28%-3.30%) for the model incorporating 1177 data.
Finally, panel E in illustrates the fitting and prediction performance for deaths. The model incorporating 1177 data achieves a substantially lower MAE of 177.78 compared with 4184.68 for the model without 1177 data, highlighting the benefit of incorporating 1177 information for improving mortality prediction.
Overall, incorporating 1177 health care helpline data improved forecasting performance across all outcomes, including confirmed cases, hospitalizations, and deaths during period 1 of the pandemic. In period 2, the model incorporating 1177 data continued to show slightly better forecasting performance compared with the model without 1177 data, although the overall performance of both models was less favorable than in period 1. In contrast, during period 3, the model without 1177 data performed better than the model incorporating 1177 data, particularly for confirmed cases and hospitalizations. These findings indicate that the forecasting benefit of incorporating 1177 data was most evident in Period 1, remained present but weaker in period 2, and was not consistently observed during period 3.
To provide a comprehensive assessment of model performance, both median errors and average reductions were evaluated over the evaluation period (May 1, 2020, to December 1, 2020). Median MAPE values showed marginal differences between models with and without 1177 data across all outcomes, being 61.6% (IQR 37.6%-79.6%) and 61.4% (IQR 40.6%-91.1%) for confirmed cases, 37.5% (IQR 18.9%-57.5%) and 41.0% (IQR 19.1%-66.0%) for hospitalizations, and 0.65% (IQR 0.3%-1.9%) and 0.74% (IQR 0.3%-2.2%) for deaths. In contrast, the average reductions in MAPE were 15.7, 8.17, and 1.99 percentage points, while the corresponding average reductions in MAE were 685, 53.40, and 101 for confirmed cases, hospitalizations, and deaths, respectively, indicating the greatest improvement for case predictions and confirming overall improved predictive performance following incorporation of 1177 health care helpline data.


Discussion
In this study, 2 epidemiological models were developed and evaluated: a baseline SIcHRD model without 1177 data and an extended SIsIcHRD model integrating individual-level syndromic surveillance data from the Swedish 1177 health care helpline. The aim was to assess the contribution of health care helpline data to predicting COVID-19 infections. To contextualize model performance, the calling volume data were divided into 3 temporal periods: period 1 (March 2 to June 10, 2020), during which call volumes increased from 19,785 to 48,869; period 2 (June 11 to August 31, 2020), where call volumes gradually decreased from 48,555 to 22,440; and period 3 (September 1 to December 31, 2020), during which call volumes further declined, ranging from 22,515 to approximately 6000. It was observed that higher call volumes during period 1 coincided with lower prediction errors and more stable model performance. The relatively poorer performance observed during period 2 may be partly attributable to the decline in call volume, which reduced the amount of syndromic information available to the model. In addition, changes in health care-seeking behavior during the summer period, including increased travel and social gatherings, may have altered symptom-reporting patterns. The increased availability of COVID-19 testing services may also have reduced the need for individuals to report their symptoms through the 1177 helpline. During period 3, model performance was less favorable, coinciding with a substantial decline in call volume, as fewer individuals reported COVID-19–related symptoms through the 1177 helpline. In addition, the increasing availability of self-testing toward the end of 2020 and greater public awareness of COVID-19 symptoms may have influenced individuals’ decisions to test and seek health care. Overall, the reduced call volume, together with changes in health care-seeking behavior, testing practices, and epidemic dynamics, may have contributed to the reduced forecasting performance observed during periods 2 and 3. Thus, although 1177 data were associated with improved model performance during the earlier periods of the pandemic, their additional predictive value was less evident toward the end of 2020.
Furthermore, the relatively high median MAPE of 61.6% for confirmed cases indicates substantial error in the point forecasts and limits their interpretation as precise estimates of the absolute number of confirmed cases. Several previous studies have reported substantial variation in forecasting accuracy across models, epidemic phases, and forecasting horizons [,]. Therefore, the median MAPE observed in our study should be interpreted in the context of the forecasting horizon and the temporal variation in COVID-19 epidemic dynamics.
Incorporating syndromic surveillance data from the 1177 health care helpline improved short-term forecasting performance, reducing MAPE on average by 15.7 percentage points for confirmed cases, 8.2 percentage points for hospitalizations, and 2.0 percentage points for death cases compared to the model without 1177 data. The model effectively captured early infection dynamics during period 1 and maintained reasonable predictive performance during period 2, whereas its performance declined during period 3. These findings highlight the importance of syndromic surveillance data, particularly during the initial phase of a pandemic.
Syndromic surveillance has previously been used in various contexts, including online search trends, symptom-reporting platforms, and mobile health applications, to support early outbreak detection [,]. A study conducted in 2025 found that anomalies detected in 1177 health care helpline calls occurred 7 days before confirmed COVID-19 cases, 13 days before hospitalizations, and 22 days before deaths in Sweden []. These findings further support the role of helpline-based syndromic data as an early warning signal for emerging outbreaks. In another study, the authors reviewed syndromic surveillance approaches by examining 4 main data streams: emergency department and hospital records, pharmacy and over-the-counter sales, citizen-generated participatory data, and hybrid multisource systems []. Their analysis demonstrated that syndromic indicators could detect outbreaks 2-14 days earlier than conventional laboratory reporting, highlighting their potential for timely epidemic detection.
Previous studies have demonstrated the importance of telehealth-based syndromic data for monitoring infectious disease dynamics. In particular, Spreco et al [] showed that aggregated 1177 health care helpline symptom data could be used for nowcasting COVID-19 trends. They reported satisfactory nowcasting performance for COVID-19 hospitalizations based on reported adult cough symptoms during the high transmission period (April 5-April 25, 2020), with MAPE ranging from 3%-9%, whereas fever-based nowcasting showed substantially higher errors (14%-52%) during the same period. Their approach relied on analyzing temporal trends in aggregated symptom data. In contrast, our study integrates individual-level 1177 symptom to trace individuals across disease states, enabling direct observation of their trajectories through the different compartments. This allows us to assess what happens following symptom reporting, specifically, whether individuals are subsequently confirmed by testing positive, thereby providing real-world evidence on the predictive value of syndromic data. Notably, during period 1 (May 1 to June 10, 2020), the model incorporating 1177 data achieved a median MAPE of 31.37% for confirmed cases. For hospitalizations, the median MAPE was 11.72%, indicating improved predictive performance compared to confirmed cases. For deaths, the model performed best, with a median MAPE of 1.71% over the same period.
A key strength of our study is that the proposed model can predict confirmed COVID-19 cases, hospitalizations, and deaths during the early stage of the pandemic, when call volumes to the 1177 health care helpline were exceptionally high due to heightened public concern and anxiety. The baseline SIcHRD model (without 1177 data) showed relatively poor performance during the initial period of the pandemic, likely due to limited testing capacity and reporting delays, which emphasizes the importance of complementary syndromic surveillance data during emerging outbreaks. Incorporating individual-level 1177 symptom data allowed the model to distinguish between laboratory-confirmed cases, unconfirmed symptomatic callers, and hospital cases, thereby reducing predictive errors. These findings highlight that the relative performance of compartmental models and complementary surveillance approaches may vary across different phases of an epidemic or pandemic. During the early phase of an emerging outbreak, when transmission patterns, testing practices, and health care-seeking behavior may change rapidly, syndromic surveillance data may provide useful complementary information when routine surveillance systems are still developing. As the epidemic progresses and surveillance and testing systems become more established, conventional compartmental models may provide useful forecasting information, while the additional contribution of syndromic surveillance may become less evident.
The limitations of this study include reliance on 1177 symptom data, which does not capture individuals who did not contact the service and may therefore miss a substantial number of infections. Although we could follow individuals after symptom reporting using register data, we could not distinguish between untested positive cases and calls related to non-COVID-19–related health issues. Another limitation of this study is that 13 parameters were estimated simultaneously from 3 observed time series. Structural and practical identifiability of the estimated parameters were not formally assessed []. Therefore, the uniqueness of the parameter estimates and their reliability under the available data cannot be formally established from the current analysis. Additional factors likely contributing to higher errors include testing delays and underreporting, as well as changes in social behaviors in light of public health recommendations that abruptly altered transmission patterns. Additionally, the use of a daily rolling window may introduce inaccuracies during weekends and holidays. The visualized error trends further highlight the advantage of integrating syndromic surveillance data into infectious disease modeling. Although the baseline SIcHRD model performed reasonably well during stable transmission periods, its simplified formulation limited its ability to capture complex epidemic dynamics, particularly during periods of rapid trend changes or multiple waves. The fitted curves often followed smooth exponential-like patterns, reflecting the absence of early symptomatic signals and reduced structural flexibility, which made the model less stable during abrupt shifts in transmission.
Future work could focus on expanding the model by integrating additional data streams, such as mobility patterns, demographic characteristics, vaccination information, wastewater surveillance, and internet search trends, to further improve forecasting accuracy while also accounting for time lags and reporting delays [-]. In addition, sensitivity analysis and formal assessments of the structural and practical identifiability of the estimated parameters should be conducted to evaluate the robustness and reliability of the model parameter estimates.
Overall, integrating individual-level syndromic data from the 1177 health care helpline improved short-term COVID-19 forecasting performance during the early stage of the pandemic. The extended model captured early changes in transmission and provided more accurate predictions of confirmed cases, hospitalizations, and deaths during this period. These findings highlight the value of incorporating high-resolution syndromic surveillance data into epidemiological modeling frameworks, while emphasizing the need to account for reporting structures and context-specific data limitations. Although this study uses the Swedish 1177 health care helpline, the proposed framework could be adapted to other health care systems with accessible telehealth or syndromic surveillance data. However, its effectiveness and generalizability may depend on differences in health care-seeking behavior, reporting practices, data availability, and telehealth infrastructure across settings.
Acknowledgments
This research was conducted within SWECOV—the Swedish Register-Based Research Program on COVID-19—hosted by Stockholm University.
Generative AI Use
In this study, generative AI tools, including ChatGPT, were used solely for language editing, rephrasing, and improving the clarity and readability of the manuscript. The study concept, methodology, analysis, interpretation of results, and scientific content were developed and determined by the authors.
Funding
The SWECOV (Swedish Register-Based Research Program on COVID-19) project was financed by Riksbankens Jubileumsfond (RIK21-0004). The study was supported by funding from the Swedish Civil Contingencies Agency (MSB; grant 2024-03120), the Swedish Research Council (grants 2021-04665 and 2022-06358), and through eSSENCE (eSSENCE@LU 10:6).
Data Availability
The data used in this study consist of individual-level records from the Swedish 1177 health care helpline, integrated with national health register data. Due to ethical and legal restrictions under the SWECOV (Swedish Register-Based Research Program on COVID-19) project, these data are not publicly available. Researchers may request access after approval by the Swedish Ethical Review Authority and the respective data providers.
Authors' Contributions
Conceptualization: SM, DD, JB
Methodology: SM
Formal analysis: SM
Investigation: DD, JB
Data curation: SM, DD, JB
Software: SM
Supervision: DD, JB
Writing–original draft: SM
Writing–review & editing: DD, JB
SM developed the model, performed model analysis, and carried out coding. DD and JB contributed to the interpretation of results and critically reviewed and edited the manuscript.
Conflicts of Interest
None declared.
References
- Dias RA. Towards a comprehensive definition of pandemics and strategies for prevention: a historical review and future perspectives. Microorganisms. 2024;12(9):1802. [FREE Full text] [CrossRef] [Medline]
- COVID-19 Excess Mortality Collaborators. Estimating excess mortality due to the COVID-19 pandemic: a systematic analysis of COVID-19-related mortality, 2020-21. Lancet. 2022;399(10334):1513-1536. [FREE Full text] [CrossRef] [Medline]
- Chen J, Qi T, Liu L, Ling Y, Qian Z, Li T, et al. Clinical progression of patients with COVID-19 in Shanghai, China. J Infect. 2020;80(5):e1-e6. [FREE Full text] [CrossRef] [Medline]
- WHO Director-General's opening remarks at the media briefing on COVID-19 - 11 March 2020. World Health Organization. URL: https://www.who.int/news-room/speeches/item/who-director-general-s-opening-remarks-at-the-media-briefing -on-covid-19---11-march-2020 [accessed 2026-10-14]
- Pashakhanlou AH. Sweden's coronavirus strategy: the public health agency and the sites of controversy. World Med Health Policy. 2022;14(3):507-527. [FREE Full text] [CrossRef] [Medline]
- Ludvigsson JF. The first eight months of Sweden's COVID-19 strategy and the key actions and actors that were involved. Acta Paediatr. 2020;109(12):2459-2471. [FREE Full text] [CrossRef] [Medline]
- Dahlström C, Lindvall J. Sweden and the COVID-19 crisis. In: The Quality of Government Institute. Gothenburg, Sweden. University of Gothenburg; 2021.
- Nsubuga P, White ME, Thacker SB, Anderson MA, Blount SB, Broome CV. Public health surveillance: a tool for targeting and monitoring interventions. In: Disease Control Priorities in Developing Countries. Walton Street, Oxford, England. The World Bank/Oxford University Press; 2011:997-1018.
- Giordano G, Blanchini F, Bruno R, Colaneri P, Di Filippo A, Di Matteo A, et al. Modelling the COVID-19 epidemic and implementation of population-wide interventions in Italy. Nat Med. 2020;26(6):855-860. [FREE Full text] [CrossRef] [Medline]
- Miller JC. Mathematical models of SIR disease spread with combined non-sexual and sexual transmission routes. Infect Dis Model. 2017;2(1):35-55. [FREE Full text] [CrossRef] [Medline]
- Tuite AR, Fisman DN, Greer AL. Mathematical modelling of COVID-19 transmission and mitigation strategies in the population of Ontario, Canada. CMAJ. 2020;192(19):E497-E505. [FREE Full text] [CrossRef] [Medline]
- Cooper I, Mondal A, Antonopoulos CG. A SIR model assumption for the spread of COVID-19 in different communities. Chaos Solitons Fractals. 2020;139:110057. [FREE Full text] [CrossRef] [Medline]
- Allen LJ. Some discrete-time SI, SIR, and SIS epidemic models. Math Biosci. 1994;124(1):83-105. [CrossRef] [Medline]
- Mwalili S, Kimathi M, Ojiambo V, Gathungu D, Mbogo R. SEIR model for COVID-19 dynamics incorporating the environment and social distancing. BMC Res Notes. 2020;13(1):352. [FREE Full text] [CrossRef] [Medline]
- Anwar MN, Smith L, Devine A, Mehra S, Walker CR, Ivory E, et al. Mathematical models of Plasmodium vivax transmission: a scoping review. PLoS Comput Biol. 2024;20(3):e1011931. [FREE Full text] [CrossRef] [Medline]
- Güemes A, Ray S, Aboumerhi K, Desjardins M, Kvit A, Corrigan A, et al. A syndromic surveillance tool to detect anomalous clusters of COVID-19 symptoms in the United States. Sci Rep. 2021;11(1):4660. [FREE Full text] [CrossRef] [Medline]
- Rolland E, Moore KM, Robinson VA, McGuinness D. Using Ontario's "Telehealth" health telephone helpline as an early-warning system: a study protocol. BMC Health Serv Res. 2006;6:10. [FREE Full text] [CrossRef] [Medline]
- Elliott A, Singh N, Loveridge P, Harcourt S, Smith S, Pnaiser R. Syndromic surveillance to assess the potential public health impact of the Icelandic volcanic ash plume across the United Kingdom, April 2010. Euro Surveill. 2010;15(23). [CrossRef]
- Kennedy B, Fitipaldi H, Hammar U, Maziarz M, Tsereteli N, Oskolkov N, et al. App-based COVID-19 syndromic surveillance and prediction of hospital admissions in COVID symptom study Sweden. Nat Commun. 2022;13(1):2110. [FREE Full text] [CrossRef] [Medline]
- Varsavsky T, Graham MS, Canas LS, Ganesh S, Capdevila Pujol J, Sudre CH, et al. Detecting COVID-19 infection hotspots in England using large-scale self-reported data from a mobile application: a prospective, observational study. Lancet Public Health. 2021;6(1):e21-e29. [FREE Full text] [CrossRef] [Medline]
- Canas LS, Sudre CH, Capdevila Pujol J, Polidori L, Murray B, Molteni E, et al. Early detection of COVID-19 in the UK using self-reported symptoms: a large-scale, prospective, epidemiological surveillance study. Lancet Digit Health. 2021;3(9):e587-e598. [FREE Full text] [CrossRef] [Medline]
- Menni C, Valdes AM, Freidin MB, Sudre CH, Nguyen LH, Drew DA, et al. Real-time tracking of self-reported symptoms to predict potential COVID-19. Nat Med. 2020;26(7):1037-1040. [FREE Full text] [CrossRef] [Medline]
- Fry R, Hollinghurst J, Stagg HR, Thompson DA, Fronterre C, Orton C, et al. Real-time spatial health surveillance: mapping the UK COVID-19 epidemic. Int J Med Inform. 2021;149:104400. [FREE Full text] [CrossRef] [Medline]
- McBryde ES, Meehan MT, Adegboye OA, Adekunle AI, Caldwell JM, Pak A, et al. Role of modelling in COVID-19 policy development. Paediatr Respir Rev. 2020;35:57-60. [FREE Full text] [CrossRef] [Medline]
- Lampos V, Majumder MS, Yom-Tov E, Edelstein M, Moura S, Hamada Y, et al. Tracking COVID-19 using online search. NPJ Digit Med. 2021;4(1):17. [FREE Full text] [CrossRef] [Medline]
- Hu R, Aziz MHN, Mohamed NA, Aruchunan E. Modeling and analysis of dynamical behavior in a fractional-order COVID-19 epidemic model with media coverage: a case study of Malaysia. Alexandria Eng J. 2025;127:1081-1095. [CrossRef]
- Hu R, Aziz MHN, Aruchunan E, Mohamed NA. Modeling and analysis of a delayed fractional order COVID-19 SEIHRM model with media coverage in Malaysia. Sci Rep. 2025;15(1):25305. [FREE Full text] [CrossRef] [Medline]
- Drew DA, Nguyen LH, Steves CJ, Menni C, Freydin M, Varsavsky T, et al. COPE Consortium. Rapid implementation of mobile technology for real-time epidemiology of COVID-19. Science. 2020;368(6497):1362-1367. [FREE Full text] [CrossRef] [Medline]
- Liu WJ, Bi Y, Wang D, Gao GF. On the centenary of the Spanish flu: being prepared for the next pandemic. Virol Sin. 2018;33(6):463-466. [FREE Full text] [CrossRef] [Medline]
- Ritterman J, Osborne M, Klein E. Using prediction markets and Twitter to predict a swine flu pandemic. 2009. Presented at: Proceedings of the 1st International Workshop of Mining Social Media; 2009 November 9; Sevilla, Spain.
- Barclay E. Predicting the next pandemic. Lancet. 2008;372(9643):1025-1026. [FREE Full text] [CrossRef] [Medline]
- Wan Mohamad Nawi WIA, K Abdul Hamid AA, Lola MS, Zakaria S, Aruchunan E, Gobithaasan RU, et al. Developing forecasting model for future pandemic applications based on COVID-19 data 2020-2022. PLoS One. 2023;18(5):e0285407. [FREE Full text] [CrossRef] [Medline]
- Hashemi AS, Dietler D, Fall T, Inghammar M, Johansson AF, Bonander C, et al. Time series anomaly detection in helpline call trends for early detection of COVID-19 spread across Sweden, 2020. Sci Rep. 2025;15(1):32701. [FREE Full text] [CrossRef] [Medline]
- Spreco A, Jöud A, Eriksson O, Soltesz K, Källström R, Dahlström Ö, et al. Nowcasting (short-term forecasting) of COVID-19 hospitalizations using syndromic healthcare data, Sweden, 2020. Emerg Infect Dis. 2022;28(3):564-571. [FREE Full text] [CrossRef] [Medline]
- van Zoest V, Lindberg K, Varotsis G, Osei FB, Fall T. Predicting COVID-19 hospitalizations: the importance of healthcare hotlines, test positivity rates and vaccination coverage. Spat Spatiotemporal Epidemiol. 2024;48:100636. [FREE Full text] [CrossRef] [Medline]
- Botz J, Valderrama D, Guski J, Fröhlich H. A dynamic ensemble model for short-term forecasting in pandemic situations. PLOS Glob Public Health. 2024;4(8):e0003058. [FREE Full text] [CrossRef] [Medline]
- Chharia A, Jeevan G, Jha RA, Liu M, Berman JM, Glorioso C. Accuracy of US CDC COVID-19 forecasting models. Front Public Health. 2024;12:1359368. [FREE Full text] [CrossRef] [Medline]
- Sen A, Stevens NT, Tran NK, Agarwal RR, Zhang Q, Dubin JA. Forecasting daily COVID-19 cases with gradient boosted regression trees and other methods: evidence from U.S. cities. Front Public Health. 2023;11:1259410. [FREE Full text] [CrossRef] [Medline]
- Getsova Z, Rangelova V. Syndromic surveillance-review on different practices' performance and added value for public health. Epidemiologia (Basel). 2026;7(1):23. [FREE Full text] [CrossRef] [Medline]
- Tuncer N, Le TT. Structural and practical identifiability analysis of outbreak models. Math Biosci. 2018;299:1-18. [CrossRef] [Medline]
- Peccia J, Zulli A, Brackney DE, Grubaugh ND, Kaplan EH, Casanovas-Massana A. SARS-CoV-2 RNA concentrations in primary municipal sewage sludge as a leading indicator of COVID-19 outbreak dynamics. medRxiv. Preprint posted online on June 12, 2020. [CrossRef]
- Ward T, Johnsen A, Ng S, Chollet F. Forecasting SARS-CoV-2 transmission and clinical risk at small spatial scales by the application of machine learning architectures to syndromic surveillance data. Nat Mach Intell. 2022;4(10):814-827. [CrossRef]
- Wass LM, O'Keeffe Hoare D, Smits GE, Osman M, Zhang N, Klepack W, et al. Syndromic surveillance tracks COVID-19 cases in university and county settings: retrospective observational study. JMIR Public Health Surveill. 2024;10:e54551. [FREE Full text] [CrossRef] [Medline]
Abbreviations
| MAE: mean absolute error |
| MAPE: mean absolute percentage error |
| SIcHRD: susceptible-infectedconfirmed-hospitalized-recovered-deceased |
| SIR: susceptible-infected-recovered |
| SIsIcHRD: susceptible-infectedsuspected-infectedconfirmed-hospitalized-recovered-deceased |
Edited by A Mavragani, T Sanchez; submitted 16.Jun.2026; peer-reviewed by E Aruchunan, A Carnahan; comments to author 28.Jul.2026; revised version received 16.Sep.2026; accepted 12.Oct.2026; published 29.Oct.2026.
Copyright©Shomaila Mazhar, Jonas Björk, Dominik Dietler. Originally published in JMIR Public Health and Surveillance (https://publichealth.jmir.org), 29.Oct.2026.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Public Health and Surveillance, is properly cited. The complete bibliographic information, a link to the original publication on https://publichealth.jmir.org, as well as this copyright and license information must be included.










